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Abstract 



COLOR ADVISOR 



A method of determining a displayable color for a current foreground image 
s component (J 04) intended to be displayed over at least one background image component 
(1 (E) having a background color is disclosed. The foreground image component is one of 
a plurality of foreground image components having a predetermined positional 
interrelationship. The method comprises analysing dominant colors of a background 
image component (102) over which the foreground image component (104) is to be 
id displayed to provide one or more representative colors. At least one displayable color of 
a previously determined foreground image component Is then examined to determine a * 

• * »w 

• • m 

level of contrast with the representative colors. If the level of contrast is at least a 
predetermined level, the displayable color of the corresponding previously determined 
foreground image component is assigned to the current foreground image component. If 
is the level of contrast fails below the predetermined level, a predetermined set of rules are 
applied to select the displayable color from a predetermined palette of colors. 
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COLOR ADVISOR 

Field of the Invention 

The present invention relates to the selection of color for image components,, Such 
as the characters in a text string or graphical objects, intended for display or printed over 
s some color background by a colour display apparatus or hardcopy printout. 

Background Art 

When text is required to be displayed or printed on a colorful background 
incorporating images and/or graphic objects, it often transpires that the text optically 
merges with, or is absorbed by, the background colors and becomes difficult, and 

io sometimes impossible, to read. The same problem often occurs in the display of animated 
images, such as those formed by graphical objects over some backgrounds. These 
problems are often encountered with subtitles in motion picture Ofrru> or videos. An 
extreme example of this effect is the well-known Ishibara Color Blindness Test. 

There are a few computational approaches that can be employed to make 

is foreground image components distinctive from background image components. One 
approach to make foreground text readable is to introduce an additional plain color 
(opaque) strip over the primary (background) image before the text is painted onto the 
"new** strip. The disadvantage with this approach is that the strip may block out 
important information in the primary image. 

20 Another approach is to use a colored transparency strip instead of an artificial 

solid' background This is an improvement over the previous approach but a portion of 
the original surface will still be distorted by the band of transparency, 

• Another approach, analyses the color content of die underlying surface, and the 
text is outlined with a color complementary to the predominant color of the background 

23 while the body of the text is filled with the dominant color of the analysed region. This 
technique produces a so-called "wired- frame" font. The success of this approach depends 
upon the size of the font being used, A smaller font may not be suitable with this 
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approach as the color distinctions may not be readily apparent Also, it may not be 
desirable to have a wired-frame font all the time- 
It is an object of the present invention to address the deficiencies of existing 
arrangements, 

5 * Summary of the Invention 

Ir. accordance with one aspect 6f the present invention' there is disclosed a method 
• of determining a displayable color ftr- a current foreground imafce component intended to 
be displayed over at tease one background' image component having a background color, 
said foreground image component being one of a plurality of foreground image 
«o components having a predetermined positional interrelationship, said method comprising 
the steps of: 

analysing dominant colors of a background image component over which said 
foreground image component is to be displayed to provide one or more representative 
colors; 

is examining at least one displayable color Of a previously determined- foreground 

image component from said' plurality of foreground image components to determine a 
level of contrast with said representative colors; 

wherein if the level of contrast is at least a predetermined level, assigning the 
displayable color of the corresponding previously determined foreground Image 
a> component to said current foreground image component; and 

if the level of contrast fells below said predetemuncd level, applying a 
predetermined set of rules using said dominant colors to select said displayablc color from 
a predetermined palette of colors. 

hi accordance with another aspect of the present invention there is disclosed a 
35 method of determining a displayablc color for each foreground image component of a 
group of foreground image components to be displayed over a background image having 
a p lurality of colors, said method comprising the steps of; 

^(a) establishing a palette of colors from which said displayable colors are to 
be selected; 

48*99 Ax 
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(b) for each said foreground image component 

(bl) determining from an area of said, background image over which 
said foreground image component is to be rendered, one or more dominant colors 
of said background image; 
> (b2) selecting a color from a list of previous foreground colors and 

comparing said selected color against said dominant colors to determine a current 
ieve) of contrast; 

Q>3) comparing said current level of contrast with a predetermined 
level of contrast, wherein if said current level is at least said predetermined level; 
10 (b3a) said selected color is assigned as said displayable color for 

said foreground image component; or 
•j" [y 0*b) repeating steps (b2) and (b3) until each member of said list 

\iy has been considered whereupon; 

J*\ ( c > if&did list is empty or each said member has been considered: 

15 . . applying a precctennined sei of rules using said dominant Co Jots 

to determine said displayable color from said palette; and 
5 » a **: (c2) adding said displayablc color to said bsl. 

According to still another aspect of the present invention there is disclosed a 
system for taennining a displayable colour for a current foregoing image component 
\\ m \ » intended to. be djspkyed over at least one background image component having a 
background color, said foreground image component being one of a plurality of 
foreground image components having a predetermined positional interrelationship, said 
system comprising: 

means for analysing ^dominant, colors of a background image component over 
25 which said foreground image component is to be displayed to provide one or more 
representative colors; 

means for examining at least one displayable colour of a previously determined 
g?^£> foreground image component from said plurality of foreground image component*; 
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means for determining a level of contrast with said representative colors 
depending on said examination; 

means for asking the displayable color of the corresponding previously 
determined foreground image component to said current foreground image component, if 
* lhe ,cvel of contrast is at feast a predetermined level; and 

means for applying a predetermined set of rules using said dominant colors to 
select said displayable color from a predetermined palette of colors, if ihe level of contrast 
falls below said predetermined leveL 

Other aspects of the invention are also disclosed. 

Brief Description of theDrawingj 
A preferred embodiment of the present invention will now be described with 
reference to the drawings in which: 

1 is a schematic block diagram of an implementation of the preferred 

embodiment: 

Fig. 2 is a flowchart depicting operation of the preferred embodiment; 
Fig. 3 illustrates one example Implementation of the preferred embodiment; 
Fig. 4 is a block diagram of a general purpose computer upon which the preferred 
embodiment of the present invention can he practiced; and 

Appendix A is a program/pscudo code listing of the preferred embodiment. 

Detailed Description 
Fig. I scbcmaricalry shows a system 100 for generating foreground color for a 
String of text such that each character can adapt to the color changes of the underneath 
background image, while a number of foreground colors used can be controlled so that 
variability of colors can be manipulated. 

In Kg. t, an image 102 and tat 104 are provided to a foreground color 
advisor 106 of the preferred embodiment The image 102 may be formed of bitmap, pixel 

i including graphical object data such as computer 
> of any style, sire, or combination of both, and is 



^^j^cr other known image data types i 
^njmation. The text 104 may be o 



fended to be rendered in the foreground (on top ol) the image data 102. The color 
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advisor 106 examines the image 102 at locations whew the text 104 is present and 
determines color attributes for each character in the text 104 which are output lOS to be 
used in the rendering of the combined image. 
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The color advisor 106 operates according to a number of method steps 200 as 
illustrated in Fig. 2. 

Initially, at step 202 a user chooses a desired color style of the foreground text 
from a set of templates; Each template contains rules for a particular color style ox 
5 scheme, for example complementary, supplementary, designer, punky, chiJdrens, etc. 
Example of such color schemes are those available with the Windows™ operating system 
manufactured by NficroSoftTnc; 

At step 204, a string of characters is entered such that the user can use some means 
(using a cursor or specifying the coordinate) to indicate the start location where the text is 
»o to be placed. The user at this stage may also specify the font 'information to be used (font 
type, font size, etc). Preferably, the user is provided with a means to provide the system 
with a maximum number of previously generated foreground colors {maxColor) to look 
up for use in color advising. For example, only a li mited color palette may be available in 
some applications. Further, this may be desirable to avoid the final text appearing too 
»s colorful. 

Step 206 which follows, commences a recursive procedure for advising a 
particular color for each character in the text string, which examines the first character 
from the string of text, and uses the current position specified by user as the start location 
{siwtjc, start _y) for the character. Using the font information available, step 206 

» determines the width (w) and height (h) occupied by the current character. 

• Step 20$ applies color analysis to determine the dominant colors covered by the 
area at location (stnrtjc, start_y\ which has a. width of w and a height of h. The dominant 
colors may be determined in a number of ways-. One method is to examine the defined 
area and count the instances of each color within the area. This may produces first, 

u second and third (for example) dominant colors, any of which may be considered of 
selected as required. A specific example of a useful color analysis method that may be 
alternatively used is that disclosed in Australian Patent Pubhcation No. AU-A-8&325/9S 
(Attorney Ref; 42524$ CP? 1007 MmediaOS), The result of this analysis returns a limited 
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number of representative (or dominant) colors. Typically, the number of representative 
colors returned will depend on the size of the area examined- 

Tn step 210, a pointer (p) is set to be the last element of a list of previously 
generated foreground colors (iprev^fgjcolor). If no such list exists (ie. the list is empty as 
s is the case for the first character in a text string), step 212 uses the rules from the selected 
templdte to generate an appropriate foreground color for the current character with respect 
to the dominant color information from the analysis of step 208. In step 214 the 
generated foreground color information is attached to the current character and this 
generated foreground color is added to the end of the list of generated foreground colors 

Step 722 follows which assesses whether there are remaining characters in the text 
string, If so, control returns to step 206. This may be achieved by incrementing start 
by w, to thus obtain the starting location of the next character in the text string. 

Where* at step 210 the list includes one or more previously generated colors, step 
15 216 follows which tests the compatibility of the generated foreground color at a previous 
Focation p from the list of previous generated foreground colors (Jprev_jg_cohr} with the 
dominant colors fox the current area. This may be performed using any one of a number 
of known contrasting color determining methods. 

Step 218 determines if the previous generated foreground color is at an acceptable 
20 and compatible level with, the background dominant color at the current location. If so, . 
step 220. follows by applying the foreground, color information to the current character* 
Since that foreground color was extracted from the top of the list, the* list does not require 
updating. If ma size of the list of previous generated foreground colors (lprevjg_color) 
is or exceeds the maximum size {muxCoior) specified by the user, one approach is to shift 
is out the less frequent used color. 

' If the color is not acceptable, ths pointer p is decremented and control returns to 
step 2 10 which proceeds to examine the next color m the list in a corresponding manner. 
In this fashion color advising for any character in the text string is first performed using 
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those colors in the list of previously used color. Specifically, in the preferred 
embodiment, the previously used colors are checked in order of most recent use. 

If the pointer p is -decremented to zero, step 212 is applied to extract an 
appropriate color from the template as occurs >*ith the first character. 
> Next, step 222 is again encountered and acted upon as before. 

When there arc no more characters in the string to be processed, the string of 
characters and their color attributes are output to the Tenderer for display. 

The preferred embedment relics upon the notion that a text string, being an 
ordered collection of objects having distinct shape and positional mterrclationship, 
io provides the capacity for possible ihcrementaJ color changes between characters to ensure 
visibility over a background. With this, the amount of contrast between individual text 
characters may be reduced where desired whilst ensuring a desired level of contrast with 
the background. This may, in some applications, produce a result somewhat equivalent to 
a color blend across the text string, 
is The preferred embodiment of the invention is implemented as an application 

program typically operating on a conventional general-purpose (host) computer system, 
such as the computer system 40 shown in Fig. 4, wherein the application program is. 
implemented as software executed On the computer system 40. The computer system 40 
comprises a computer module 41, input device* such as a Iceyboard 42 and mouse 43, 
20 output devices including a printer 1* and a display device 1 1. The Keyboard 42 and 
mouse 43 may be used in a conventional manner for the entry of the text string and the 
positioning of the text string to thus specify start jc and start_y> A Modulator- 
Demodulator (Modem) transceiver device 52 is used" by the computer module 41 for 
communicating to and from a communications network, for example cormcctable via a 
u telephone line or other functional medium. The modem 52 can be used to obtain access 
to the Internet, end other network systems. 

The computer module 41 typically includes ai least one processor unit 45, a 
memory unit 46, for example formed from semiconductor random access memory (RAM) 
and read only memory (ROM), input/Output (I/O) interfaces including a videp interface 

CFN58SAU MMtdMl 41W» IIAKLECSCtSRAVMMEDlA\MMED(A3{)439(W^«:W{> 
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47, and an I/O interface 48 for the keyboard 42 a mouse 43 and optionally a joystick (not 
illustrated). A storage device 49 is provided and typically includes a bard disk drive 53 
and a floppy disk drive 54. A CD-ROM drive 55 is typically provided as a non- volatile 
source of data. The components 45 to 49 and 53 to 55 of the computer module 41, 
5 typically communicate via an interconnected bus 50 and in a manner which results in a 
conventional mode of operation of the computer system 40 known to those in the relevant 
art. Exanrpfes of computers on which the" e^bodimeitis caui be practised include IBM- 
PCs and compatibles. Sun Sparcstations or alike computer systems evolved therefrom. 
Typically, the application program of the preferred embodiment is resident on a hard disk 
10 drive 53 and read and controlled using the processor 45. Intermediate storage of the 
program and the print list and any data fetched hem the network may be accomplished 
■ •• S using the semiconductor memory 46, possibly in concert with the hard disk drive 53. In 

some instances, the application program may be supplied to the user encoded on a CD- 
ROM or floppy disk, or alternatively could be read by the user from the network via the 
is modem device 52. 
Example 

With reference to Fig. 3, the word "WORLD" is to be displayed over some arbitrary 
colorful background. After processing the first three characters according to the method 
200. "W* has been, suggested to use green color, the second letter "0" has been allocated 
20 blue and the third character, "R" allocated the red color. At this stage, it is then necessary 
to determine the color for the next fetter l V\ ft can be seen that the area occupied by each 
Character is not the same, in that the analysis space (h*wl) for the letter cr W > ' is deunitely 
much larger Hurt the space (h w2) for the current letter "l". 

Dominant colors over the area for character * 1 L" are known after the analysis. The 
2$ foreground colors used by its predecessor characters are tested, from the nearest character 
to the furthest character, {ie, red, blue, then green). . In other words, the first priority to try 
for the color of the letter *V is red, then, blue and finally green as indicated by the arrows 
□umbered 1, 2 and 5 respectively in Fig. 3- If the color used by its previous neighbours is 
within a threshold value to make the character stand out from its background, and is 

CFP1SBSAU MMctfftll 489099 (I:\ELEOCl5 fcANMMCDlAWMSOlAi I ]«90»Jcc:Mp 
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appropriate for the selected style, that previous color will be adopted by Jibe current 
character "l*. Otherwise, using the available rules from the chosen template of color 
style, a differcm color is generated for "L n tf the previous colors do not work in harmony 
with the background colors underlying the current character. 
5 The threshold for determining whether or not a foreground color will be 

sufficiently distinguishable from the background color may be determined in a variety of 
ways. • '.■■'*.'• 

In the preferred embodiment, the significant background co!or(s) used and the 
suggested foreground color are converted individual components for each of hue (h). 
lo saturation (S) and brightness (b). These component values are normalised. A "distance" 
factor between these normalised values may then be tfetermined, for example using the 
expression: 

distance = ((hpo-hgo) 2 -** (Sfg-Sbg) 2 + (b^-beo))* 
The threshold value may be a predetermined value of this "distance". Where 
is appropriate, other color formats, such as RGB, CMY or YCrCb may be used although the 
form of determination of "distance* may change. 

For complementary colors, it is possible to test the difference between the hue of 
each of the foreground and background. For example: 

hue = inax. saturation ( IhpG-hgQl ): H fg 3^: 0.5 
*> Alternatively, for non-conrnlementary colors, it is possible to utilize "children 11 

colors m Order to maximize brightness. In this regard, children typically prefer bright 
colors, for example with a brightness greater than 0.8. A template of such colors may be 
used to define "children colored Other color schemes such as 4< punky" or "horror" may 
also be appropriate. 

a Where 3 text character appears over a relatively abrupt change in background, in 

some embodiments a blend of colors may be applied across the text character. 

Appendix A shows program/pseudo code for implementing the preferred 
embodiment. 



i 
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The foregoing describes onJy a number of embodiments of the present invention 
and modifications may be made thereto without departing from the scope of the present 
invention. For example, although finding particular application in the display of text, the 
present invention may be applied to any arrangement of image components, graphical 
5 objects for example, that are desired to be displayed. This, for example, may apply in the 
presentation of animation overlying a piyfilinxage. It is further noted that the scope of the 
color pa|ette from which a selection is made can vary depending upon a number of user 
determinable or selectable criteria, For example where a text string is to be displayed 
over pixel image ef a jungle where the dominant colors are a variety of shades of green 
io representing different foliage, the contrast criteria may identify yellow as a suitable base 
color for the text Using such a base color, a palette having a range of yellow colors may 
be selected for use in the text. Depending on the particular shade of green over which a. 
character is to be displayed {eg. olive), a suitable color (eg. sand) may be selected &om 
the palette. Accordingly, where the background provides a blend of colors, the coloring 
i j of the overlying text can also display a. complementing blend of contrasting colors. The 
net effect of such an arrangement is that, due to the color mixing insensitivity of the 
human eye, the text string, although displayed with i range of colors (yellows) may 
appear to be formed of characters of substantially the same intensity of apparently the 
same color. In this fcshion, visibility of tee stricg may be optimised without distracting 
» the viewer with coIots spanning a wide nmge. 

As a consequence, the present invention may rind application in a wide number of 
fields, such as the production of static images by printing, and the creation of static 
electronic images for displays. The latter may include static billboards, date/time 
impressing identifiers on photograph devices as wdl as individual computer displays. 
25 Other applications include the presentation of subtitles to video or motion pictures, the 
particular embodiment being performed in real-time, for example during a television 
sports broadcast, or via pre-processing as in the ease of the production of celluloid motion 
picture films. Each of such products may incorporate the invention. 

CF71SSSAU MMcdUi p:\ELEC\C13XA\MMEDlA\MMEDIA3 1 }489099.<Joc:kip 
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APPENDIX A 

The following represents a pseudo-code representation of the preferred embodiment: 
generateNewCoJcr " false; 

FOR all the available background colours from the analysis 

IF the current background colour (r>g_cotor) is sfcnificant 
if say greater than 5% of the analysed area 

IF bp^cotorbrightness is similar to the previous generated fg^color 
OR ((fgLOOlor brightness 0.6) AND 

{bg__eolor,hue is vrarmColor) AND (bg__color saturation > 0*7)) 
generateNewColor = true 
ENDIF 
ENDIF 
ENDFOR 

IF o^nerateNewCoIor is fatee 

darn_bg_color = the first non-zero saturated dominant bg^color; 

IF |dom_bgLootor.hue - fg_cofor,hue| < OA 
genereteNewColor = true; 

ENDIF 
ENDIF 
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The claims defining the invention are as follows: 

I. A method of detenniniizg a displayable color for a current foreground image 
component intended lo be displayed over at least one background image component 
s having a background color, said foreground image component being one of a plurality of 
foreground image components having a predetermined positional interrelationship, said 
method comprising the ste^bf: ■ 

analysing dominant color* of a background image component over which said 
foreground image component is to be displayed to provide one or more representative 
io colors; 

examining at least One dtsplayabte color of a previously determined foreground 
image component from said, plurality of foreground image components to determine a 
level of contrast with said representative colors;. 

wherein if the level of contrast is at least a predetermined level, assigning the 
t> displayable color of the corresponding previously determined foreground image 
component to said current foreground image component; and 

if the level of contrast fells below said pi^etermmed level, applying a 
predetermined set of rules using said dominant colors to select said displayable color from 
a predetermined palette of colors. 

20 

2* A method of determining a displayable color for each foreground image 
component of a group of foreground image components to be displayed over a 
background image having a plurality of colors, said method comprising the seeps of; 

(a) establishing a palette of colors from which said displayable colors are to 
is be selected; 

(b) for each said foreground image component 
T -~* (bl) determining from an area of said background image over which 

said foreground image component is to be rendered, One Or more dominant colors 



of said background image; 
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(bl) selecting a color from a list of previous foreground colors and 
comparing said selected color against said dominant colors to determine a current 
level of contrast; 

(b3) comparing said current IcveJ of contrast with a predetermined 
level of contrast, wherein if said current level is at least said predetermined level; 

(i>3a) ssad selected color is assigned as said disptayable color for 

said foreground image component; Or 

(b3b) repeating steps (b2) and (b3) until each member of said list 

has been considered whereupon; 
(C) if said list is empty or each said member has been considered: 

(cl) applying a predetermined set of rules using said dominant colors 
lo determine said displayabje color from said palette; and 

(c2) adding said drsplayable color to said list 



w 3. . Arriemod according to cl^^ 
retained in said list is able to be limited. 

4. A method according to claim 2, wherein said group comprises a string of text 
characters. ■ 

5. A method according to claim" 2, 3 ox 4, wherein said foreground image 
components have a predetermined positional relationship and step (b) considers each said 
foreground image component in positional order. 

zj 6. A method according to claim 5, wherein step (bl) includes defining a position and 
area of said foreground image component to determine said dominant colors. 




A method according to any one of the preceding claims, therein at least one said 
component comprises text. ' 
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8. A method according to any one of the preceding claims, wherein said foreground 
image component comprises a .graphical object of a group of graphical objects. 

s 9. A method according to claim 8, wherein said group of graphical objects define a 
graphical image. 

10. A method of determining, -from a predetermined palette of colors, a displayable 
color for a foreground image component intended to be displayed over at least one 
id background image component substantially as described herein with reference to the 
drawings. 

1 \ . Apparatus for performing tbe method of any one of the preceding claims. 

i5 12. A computer program product, incorporating a computer readable medium having a 
series of computer interpretable- instructions for performing the method according co any 
one of claims 1 to 12. 



20 



13. An image produced using tho method of any one of claims 1 to 10. . 

14. An image according; to claim 13, being one of: . 
. . a printed image; . 

a developed image; 

a static electronic image; 

a motion electronic image: and 

a motion picture film. 




A system for determining a displayable colour for a current foregoing image 
component intended to be displayed over at least one background image component 



PAGE 55/76 1 RCVD AT 2/10/2006 12:29:47 PM [Eastern Standard Time] * SVR:USPTO«EFXRF-6/3a * DNIS:2738300 * CSID :480385506 1 1 DURATION (mm-ss):22'06 



Feb. 10. 2006 10:35AM INGRASSI A FISHER & LOR E NZ PC - No. 6142 P. 56 

f 



•14- 



having a background color, said foreground image component being one of a plurality of 
foreground image components having a predetermined positional mterrelalionship, said 
system comprising: 

means for analysing dominant colors of a background image component over 
> which said foreground image component is to be displayed to provide one or more 
representative colors; 

^ means for examining tt/Iea^one ^ displayable colour of a previously deiermincd 
foreground image component froni said plurality of foreground image components; 

means- for detemrining a level of contrast with said representative colors 
io depending on said eocaminaiion; 

means for assigning the displayablc color of the corresponding previously 
determined foreground image component to said current foreground image component, if 
the level of contrast is at least a predetermined level; and 

means for applying a predetermined set of rules using said dominant colors to 
select said displayabJe color from a predetermined palette of colors, if the level of contrast 
falls below said predetermined level. 



DATED this thirteenth Day of February, 2002 
Canois Kabnshlki kalsba 
.. ^ Patent Attorneys for the Applicant 
SPRUSON <fc FERGUSON 
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